The committee machine: computational to statistical gaps in learning a two-layers neural network
نویسندگان
چکیده
منابع مشابه
a synchronic and diachronic approach to the change route of address terms in the two recent centuries of persian language
terms of address as an important linguistics items provide valuable information about the interlocutors, their relationship and their circumstances. this study was done to investigate the change route of persian address terms in the two recent centuries including three historical periods of qajar, pahlavi and after the islamic revolution. data were extracted from a corpus consisting 24 novels w...
15 صفحه اولStatistical Mechanics of Learning in a Large Committee Machine
In a We use statistical mechanics to study generalization in large committee machines. For an architecture with nonoverlapping receptive fields a replica calculation yields the generalization error in the limit of a large number of hidden units. For continuous weights the generalization error falls off asymptotically inversely proportional to Q, the number of training examples per weight. For b...
متن کاملStatistical Machine Learning and Computational Biology
Statistical machine learning is a field that combines algorithmic ideas with foundational concepts from probability and statistics. This combination makes statistical machine learning an essential tool for computational biology, in part because probabilistic notions are inherent in biology (arising, e.g., via thermodynamics, recombination and germline mutation) and in part because of the incomp...
متن کاملA Two-stage Committee Machine of Neural Networks
In solving pattern recognition problems, many ensemble methods have been proposed to replace a single classifier by a classifier committee. These methods can be divided roughly into two categories: serial and parallel approaches. In the serial approach, component classifiers are created by focusing on different parts of the training set in different learning phases. In contrast, without paying ...
متن کاملNotes on computational-to-statistical gaps: predictions using statistical physics
In these notes we describe heuristics to predict computational-tostatistical gaps in certain statistical problems. These are regimes in which the underlying statistical problem is information-theoretically possible although no efficient algorithm exists, rendering the problem essentially unsolvable for large instances. The methods we describe here are based on mature, albeit non-rigorous, tools...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Journal of Statistical Mechanics: Theory and Experiment
سال: 2019
ISSN: 1742-5468
DOI: 10.1088/1742-5468/ab43d2